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Abstract. Let G = GL{n, F) where _F is a local field of arbitrary characteris- 
tic, and let tti , 7r2 be representations induced from characters of two maximal 
parabolic subgroups Pi, P2. We explicitly determine the space Home (tti, 172) 
of intertwining operators and prove that it has dimension < 1 in all cases. 



1. Introduction 

Let G be a reductive group over a local field F; then C°° (G) is a G x G-module 
with left and right actions given by Lgf [x) = f [g^^x), Rgf {x) = f {xg). Let 
P C G be a parabolic subgroup with modular function Ap and let x be a character 
of P. The induced representation / (P, x) is the right G-action on the space 

(1) G°° (G, P, x) ■■= {/ e G°° (G) I Lp-i/ = X {P) Ap/' {p) f for aU p G p} , 

whose elements may also be regarded as smooth sections of a line bundle on G/P. 

We are primarily interested in the group G = G„ := GL{n, F) and its parabolic 
subgroups P ~ Ppi,p2' with pi + P2 = consisting of matrices x G G„ of the form 



(2) 



Xll 





X12 
X22 



; Xij G Matp. ■ 



In this case G/P is the Grassmannian of pi-dimensional subspaces of P". The 
characters of P are of the form xi ® X2 (x) = Xi (2;ii)x2 {X22), where Xi is a 
character of Gp. . Following |BZ77] we write xi x X2 instead of / (P, xi X2)Q 

Let TTi = Xi X X2 and 7r2 = X3 x X4 be two such representations, where each Xi 
is character of Gp. with pi + P2 — Ps + Pi — n. Our main result is an explicit de- 
termination of the space Homc^ (''■i)'''2) of intertwining operators, or intertwiners 
for short; in particular we prove that it has dimension at most 1. 

It turns out that all intertwiners were previously known. The list includes such 
examples as the Radon transform and cosine transform, which are of considerable 
geometric interest; indeed these transforms were first constructed and studied in a 
geometric context, their intertwining properties being only recognized much later 
[ |GGR84] . |A10) ]. One can further supplement the list with two simple examples, 
scalar operators for tti — 1^2, and certain rank 1 operators obtained as a composi- 
tion of two rank 1 Radon transforms. Finally, for the middle Grassmannian over 
archmidean fields (P = M or C) , one also has discrete families of intertwiners given 
by certain Capelli-type differential operators. Our main contribution, in addition 
to the multiplicity 1 statement, is to show that there are no other intertwiners. 

We fix some notation to describe our main results succinctly. For z ^ F let v (z) 
denote the positive scalar by which the additive Haar measure on P transforms 
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under multiplication by z. We will also regard as a character of G„ defined 
by v{g) := i/(detg), and we note that the modular function of P = Ppi,p2 is 
Ap = v^^ ® i/^Pi. For integers i < j we write [i,j) for the character v~oi Gj-i. 
If TT = xi X X2 then we write tt — X2 x Xi- Finally we write tti tt2 to mean that 
there exists a non-zero intertwining operator from tti to 7r2. 

Proposition 1.1. For any tt = Xi ^ X2 we have tt tt and tt "-^ tt. 

Proposition 1.2. Fix an integer k > and for each integer < i < k define 
Q,; = [0, i) X [i, k); then for all integers < j =/= i < k we have 

a] ai . 

Proposition 1.3. Fix integers < i < j < k and define /3 — [0,j) x [i,k), 
7 = [0,fc) X then we have 

7 --^ /3:7 --^ 1,P --^ 7- 

Proposition 1.4. Fix an integer k > and let 1, 6, <; denote the trivial, det, and 
sgn (det) characters of GLk (R) ; then for all integers i > we have 

1 X S\ X 

Proposition 1.5. Fix an integer k > and let 1, 5, 5 denote the trivial, det, and 
det characters of GLk (C) , then for all integers i > and all integers j we have 

1 X xS^,lx S'S^ — ^ X 6^ . 

We can get additional instances of tti tt2 by considering central twists. To 
formulate this precisely wc introduce the following notation. 

Notation 1.6. Given non-negative integers Pi + P2 = Ps + Pi = n and characters 
Xi ofGp^ we write (xi, X2, X3, X4), 

H (X) = HomG„ (xi X X2, X3 X X4) 
We define the central twist of X by a character -0 of to be 

V'X = (V'Xi , • ■ • , ■0X4) with {ipxi ) (5) = '0 (det g) Xi {9) ■ 
It is easy to see that for all ip we have a natural isomorphism H (X) « H {ipX). 

Definition 1.7. We refer to the X obtained by central twists from Provositions \l.l\ 
(resp. \1.2ll.3\ ) (resp. \1.4\ \1.5]) as standard (resp. mixed) (resp. exceptional^. 

Our main result is as follows. 

Theorem 1.8. dimiJ (X) < 1 with equality iffX is standard, mixed, or exceptional. 

The intertwiners in the standard case are either scalar operators or Knapp- 
Stein operators (cosine transforms). In the mixed case the intertwiners are rank 
1 operators in Proposition II. 2[ and Radon transforms in Proposition 11.31 The 
intertwiners in the exceptional case in Propositions II .41 and II .51 are given by explicit 
differential operators. In the real case they factor through a Speh representation 
and in the complex case either their domain or their range are irreducible. 

In [2] we give some preliminaries on induced representations of reductive groups. 
In SJ3]we introduce a key tool: the Bernstein- Zelevinsky theory of derivatives. This 
tool is specific for Gn, but works uniformly over all fields. In [2] we construct 
the intertwining operators. In iJS] we finish the proof of Theorem 11.81 The proof 
is carried out by induction, using the theory of derivatives and results on finite- 
dimensional subquotients. 

1.1. Acknowledgements. We cordially thank Semyon Alesker for posing this 
question to us (for F = M) and for useful discussions. 
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2. Preliminaries 

2.1. Degenerate principal series. Let G be a reductive group over an arbitrary 
local field F. In this section we discuss some basic properties of the induced repre- 
sentation I {P, x) on C°° {G, P, x) as in ([1]). For detailed proofs we refer the reader 
to |BW80[ IWall88] and to other standard texts on representation theory. 

Let S' (G) denote the set of compactly supported distributions on G, regarded 
as a left and right G- module as usual via the pairing (•, •) : £' (G) x G°° (G) — > C. 

Lemma 2.1. Let e Cz £' (G) denote evaluation at I Cz G, then we have 

{Rp-ie, /) = X (P) Ap/' (p) (e, /) for all p e PJ e G°° (G, P, x) 

Proof. Indeed both sides are equal to / (p). □ 

Lemma 2.2. The representations I {P,x) and I (^P,x^^) are contragredient. 
Proof This is proved in |WaU88[ V.5.2.4]. □ 

Let P denote the parabolic subgroup opposite to P. Then the characters of P 
and P can be identified with those of the common Levi subgroup L = P D P. 

Proposition 2.3. There is a nonzero intertwining operator I {P, x) ^ I {Pj x) ■ 

Proof. See |KnSt71] and |Wald03] for the archimedean and non-archimedean cases. 

□ 

2.2. Finite dimensional representations. Let {(p, V) be an irreducible finite 
dimensional representation of a reductive group G. We are interested in the possi- 
bility of realizing as a submodule or quotient of some / (P, x), which we denote 
by ^ / {P, x) and / (P, x) respectively. We start with two simple results. 

Lemma 2.4. We have dimV^^'-*^ < 1 for all x, with equality for at most one X- 

Proof. This is obvious if dim V = I, while dim V > I only occurs in the archimedean 
case, where the result follows from highest weight theory. □ 

Let (0*, V*) be the contragredient representation of (0, V). 

Lemma 2.5. We have (j) ^ I {P, x) (resp. I {P,x) 4>) iff {V* f''^ ' ^''"^ (resp. 
yP^x^P J ig nonzero. For a given P , there is at most one such x in each case. 

Proof, li (j) '-^ I{P,x) then by Lemma [2.11 the restriction e\v gives an element in 

^ easily seen to be nonzero. Conversely the matrix coefficient with 
respect to such an element provides an imbedding ^ /(P, x). Next by Lemma 
12.21 we see that 

l{P,X-')-r ^ 0-^/(P,x) ^ (T/*)^^^"^-'' V 0. 

Replacing cj) by (/>* and x by x~^, we deduce / (P, x) ^ ^ *^=^ yP.X'^p ' ^ g. 
The second part of the Lemma follows from Lemma WM □ 

Proposition 2.6. If (p ^ I{P,x) (resp. I{P,x) (f>) then </> is the unique 
irreducible submodule (resp. quotient) of I{P,x)- 

Proof. By Lemma [2^ it suffices to deal with that case (j) ^ I (P, x)- If -P is minimal, 
then the result follows from the Langlands classification f |EW801 Ch IV and Ch 
XI] ) , once we note that is a Langlands submodule of / (P, x) ■ Otherwise choose 
a minimal parabolic Pq C P. Then we have 

/ (P, X) C / (Po, xo) with xo = A-;/' (x^T) \Po; 

but (j) is the unique submodule of / (Pq, xo), hence also of / (P, x)- D 



4 



DMITRY GOUREVITCH AND SIDDHARTHA SAHI 



Fix a minimal parabolic subgroup Pq C G and let M be the set of pairs (P, x) 
such that P is a maximal parabolic containing Pq and x is a character of P. 

Lemma 2.7. If dim V > 1 then cj) ^ I {P,x) (resp. I {P,x) -» (f>) for at m,ost one 

Proof By Lemma [23] it suffices to show that if (^v*f''^\{V* f^'^'' ^ for 
{Pi,Xi) £ then Pi = P2. By the Lemmas 12.41 and 12.51 we conclude that xi, 
X2 have the same restriction xo (say) to Pq, and that 

If Pi , P2 were different maximal parabolic subgroups then they would generate 
G, and the one-dimensional space {v*)^°'^" would be G-invariant, contradicting 
the assumption that V, and hence V* , is irreducible of dimension > 1. □ 

2.3. Intertwining differential operators. In this subsection we suppose that F 
is an archimedean field. Let G be a real reductive group, let P = LN be a parabolic 
subgroup and denote the opposite nilradical by N. We denote the Lie algebras of 
G,N etc. by 0,fi etc. and their enveloping algebras by U (g), U (fi) etc. The left 
and right G-actions on C°° (G) give rise to vector fields Lx,Rx for X £ q, and 
more generally to differential operators Lu,Ru for u G W (g). 

We are interested in triples {u, x, r]) where u £ U (n) and Xi V are characters 
of P such that maps the space C°° {G,P,x) to G°° {G,P,r]). Since left and 
right actions commute, such an L„ is automatically an intertwining differential 
operator between the induced representations / (P, x) and /(P, 77), and we will 
refer to (w, x, v) as an intertwining triple. 

Proposition 2.8. Suppose (a) n is abelian, (h) u transforms by the character XV^^ 
under the adjoint action of L, and (c) the product xv extends to a character of G; 
then (u, X, v) 0.1^ intertwining triple 

Proof. If 77 = x^^ then this is proved in |KV77[ Proposition 2.3], and the same 
proof works for the general case. □ 

Remark 2.9. In the context of Provosition lK^ since n is abelian, we may identify 
lA (fl) with the symmetric algebra S (fl) . Furthermore, we may identify n with n* 
and thus regard u £ S (fl) as polynomial function on n. 

3. Derivatives 

If X is a character of Gp with p > 0, we write x' for its restriction to G^-i and 
X^ for its extension to Gp+i {i.e. the unique character such that (x^)' — x)- If 
^ = (Xi: X2: X3: Xa) with all Pi > then we define 

^' = (x'l, X2, X3, ^a).^^ ^{xt,xt,xt,xt)- 

Lemma 3.1. // all pi > 1 and X' is standard, mixed or exceptional then so is X. 

Proof. Since all pi > 1 we have X — (X')^. The result is obvious if X' is standard 
or exceptional since S'^ — (5p_i etc. For the mixed case we note that if i < j then 

X = ihj) =^ v^^'^X^ = = [hJ + !)■ 

Now writing to denote equality up to a (common) central twist, we see that 

^' ^ ■ ■ Audi)) => ([ii,ii + 1), ■ ■ • , [^4, j4 + 1)) 

It follows easily that if X' is mixed then, up to a twist, X is as in Lemma ll.3l □ 
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We will prove the main result (Theorem II. 8p by induction on n, using ideas 
from |BZ77[ lAGSj . We refer the reader to those papers for the notion of depth for 
an admissible representation of G„, and for the definition of the functor $ which 
maps admissible representations of Gn of depth < 2 to admissible representations 
of G„_2- In |BZ77] this functor is denoted 

Proposition 3.2. < ^BZ77lRGS] ) 

(1) ^ is an exact functor and ^(xi ^ Xj) ^ x'i ^ x'j ifPiiPj > 1- 

(2) Every suhquotient of Xi x Xj has depth < 2 

(3) If t: has depth 1 then n is finite dimensional and $(7r) = 0. 

(4) // TT has depth 2 then $ (tt) / 

Let H{X) be as in Notation ll.6l and we let Hq (X) C H (X) denote the subspace 
of finite rank operators. 

Corollary 3.3. // Hq (X) = then $ defines an imbedding H (X) ^ H (X'). 

4. Construction of intertwining operators 

We now prove Propositions 11.11 - 11.51 As before we write tti ---> 7r2 if there exists 
a non-zero intertwining operator from tti to 7r2. 

Proof of Provosition [7771 The identity operator gives tt tt. Next we write 

P = PpuP2,X ^Xi®X2,P ^ Pp2,piiX = X2<E)Xi- 

Then we have tt ~ I [P, x) and tt — I (^P, xj ~ I [P, x) since ^F, and (F, x) 
are G-conjugate. Now we get tt tt from Proposition 12. 31 □ 

Proof of Proposition It follows from Lemma 12.51 that (j) ^ ai and Oj ^ (j), 
where is the character i^'^/^ of Gk- Thus we get a non-zero map 5j — )■ — a^. □ 

Proof of Proposition \1.3l By Proposition 11.21 and induction by stages we get maps 

7 ^ [0, j) X [j,k) X [ij) /?, 7 X [0,i) X [i,fc) ^ /3, 

/3 ^ X [0,i) X [i,j) ^ 7, /3 ^ [0, X [j,k) X ^ 7. 

To see that the composite maps are non-zero, we note that each map is non-zero on 
the one-dimensional space of vectors fixed by the maximal compact subgroup. □ 

Proof of Proposition \1.4\ Let G = GL2k (R) and P = Pk.k then n k, Matkxk (K) is 
abelian. Let it e [/ (fl) correspond, as in Remark 12.91 to the polynomial function 
det' on n, and set 

X = 1(E) S\,T] = S' 

Then u transforms by the character XV~'^ = ^ under the adjoint action of 
L = Gk X Gk, and the product xv = ® extends to the character (5* of G = G2fc. 
Thus (u, X, J?) is an intertwining triple by Proposition l2.8l and the result follows. □ 

Proof of Proposition \1.5\ This is proved similarly, using the polynomial functions 
det' and det' on n « Matkxk (C) . □ 

Remark 4.1. In Proposition \l .4\ the maps factor through the Speh representation 
(see |SaSt90) ). In Provosition \1.5\. either the source or the target of the map are 
irreducible (see |HL99j ). 
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5. Proof of Theorem 11.81 

Let Ho (X) C H{X) denote the subspace of maps of finite rank. If Hq (X) ^ 0, 
then there is a finite-dimensional representation cj) that is a quotient of xi x X2 and 
a submodule of X3 x X4- We will indicate this by writing h X. 

Proposition 5.1. We have dimH{X) < 1. 

Proof. First suppose Hq (X) ^ 0, and let h X be as above. By Proposition l2.6l (i) is 
the unique irreducible quotient of xi x X2 and the unique irreducible submodule of 
Xs^Xi- It follows that any map in H{X) factors through and hence dim iJ(X) = 1. 

If Ho (X) = then by CoroUaryES] we get an imbedding H (X) H{X'). The 
result now follows by induction on n = pi + p2 — ps + P4, with the initial cases 
71 = and n = I being trivial. □ 

Lemma 5.2. If Hq (X) ^ then X is standard or mixed. 

Proof. Let h X be as above. If dim0 = 1, then Lemma 12.51 implies that up to a 
central twist by (j) we have 

Xi X X2 = [j, n) X [0, j) and X3 x X4 = [0, i) x [i, n) for some < i, j < n. 

Thus if i = j then X is standard, otherwise X is mixed as in Lemma 11.21 

If dim (j) > \ then F is archimedean and by Lemma 12.51 is a submodule of 
X2 X Xi- By Lemma 12.71 (b is a submodule of a unique degenerate principal series. 
Thus X3 — X2 and xa = Xi and hence X is standard. □ 

Before proving the next result we make some simple observations. 

Lemma 5.3. Let X — {xi,X2TX3iXi) vjithH{X)^Q, and write Xi — ''Pi ° ^Pi^hen 

(3) ^2 = V'3 ^4 [zr for aU z^F^. 

Proof. It follows from the definition of induction that the central element z/„ e G„ 
acts on xi x X2 and X3 x Xi by the scalars tpi {zY^ 1/^2 (2)^^ and i/'s {zY^ V'4 {zY'^ . 
If HomcSxi X X2,X3 X X4) 7^ then these scalars must be the same. □ 

Corollary 5.4. Let X = (xi; X2, X3; X4) 'with H[X) ^ 0. 

(i) //pi = 1 then xi is uniquely determined by X2,X3 7X4- 
(a) Ifpi = p3 = 1 and X2 = X4, then xi = X3- 

Proof. For case (i) we note that V'l {z) = ip2 (2)^^^ ^"3 {zY^ fp4 {zY"^ by Q- In case 
(ii) we have p2 — Pi — n ~ 1 and ijj2 = ijji, hence byQ we get ipi — ip^. □ 

Proposition 5.5. If H{X) =/= then X is standard, mixed, or exceptional. 

Proof. We proceed by induction on n = pi + p2 — Pa + Pi- The case n = 1 is 
obvious and the case n = 2 follows from standard facts about principal series for 
GL2 (see e.g. |Wall881 §§5.6,5.7] for the archimedean case). Thus from now on 
we may assume that n > 3 and that the result is true for n — 2. By the previous 
lemma we may also assume that Ho (X) = 0. In particular we may assume that 
each Pi > and by induction that X' is standard, mixed, or exceptional. 

Let / be the set of indices i such that pi = I. Since n > 3, I can contain at most 
one index from each of the sets {1,2} and {3,4}. If / = then the result follows 
from Lemma |3. II 

Suppose |/| = 1. If/ = {1} then up to a central twist we have 

H{X')=Hom{[0,n-2),[0,p3~l) x [p3-l,n-2)), 

and hence we get X ^ (xi, [0,n — 1), [0,^3), [pa — l,n — 1)). By Corollary 15.41 we 
must have xi — [P3 — 1,P3), and hence X is mixed. The proof is similar if / = 
{2}, {3} or {4}. 
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Suppose |/| = 2. If / = {1, 3} then up to a central twist we get 

H{X') ^ Hom{[0,n-2),[0,n~2)) . 

Thus we have X ^ (xi, [0,ri — l),X3i [0, ?i — !))• By Coroharv 15.41 we get xi — X3 
and hence X is standard. The proof is similar in the other cases with |/| = 2. □ 

Proof of Theorem \1.8[ This follows from Propositions 11.11 - 11.51 15.11 and 15.51 □ 
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